Skip to main content
Scour
Discover
Docs
Login
Sign Up
Discover
About
Docs
Changelog
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Data Engineering
🏗️ Data Engineering
data pipelines, ETL, Apache Spark, data lakehouse
Filter Results
Timeframe
Choose a timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
213
posts in
24.3
ms
🏗️
Systems Design
Databricks
·
6d
6 days ago
What is
data
pipeline
architecture?
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for What is data pipeline architecture?
⚙️
MLOps
medium.com
·
13h
13 hours ago
The Future of
Data
Engineering
: How
AI
Is Automating the Modern
Data
Stack
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The Future of Data Engineering: How AI Is Automating the Modern Data Stack
✍️
Prompt Engineering
medium.com
·
2d
2 days ago
he Proxy That Snitched on Itself
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for he Proxy That Snitched on Itself
🧠
Transformer Architecture
GitHub
·
12h
12 hours ago
Show HN: Duckle a drag-and-drop visual
pipeline
designer
Covers
Model Context Protocol And OAuth
Discussed on
Hacker News
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Show HN: Duckle a drag-and-drop visual pipeline designer
🖧
Distributed Systems
techcommunity.microsoft.com
·
2d
2 days ago
OneLake in Azure: The
Data
Lakehouse
Revolution Changing the Future of Enterprise
Data
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for OneLake in Azure: The Data Lakehouse Revolution Changing the Future of Enterprise Data
⚙️
MLOps
Confluent Blog
·
4d
4 days ago
Meeting
Data
(and Analytics)
Engineers
Where They Are: Introducing the
dbt
Adapter for Confluent Cloud
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Meeting Data (and Analytics) Engineers Where They Are: Introducing the dbt Adapter for Confluent Cloud
🏗️
Systems Design
getdbt.com
·
23h
23 hours ago
The analytics
engineer
in 2026: system designer, governance owner,
AI
context provider (5 minute read)
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for The analytics engineer in 2026: system designer, governance owner, AI context provider (5 minute read)
🖧
Distributed Systems
thedatabytes.substack.com
·
2d
2 days ago
Databricks
vs. AWS managed service which one fits your need?
Discussed on
Substack
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Databricks vs. AWS managed service which one fits your need?
📈
LLM Scaling
Databricks
·
6d
6 days ago
Introducing
Lakehouse
//RT: Real-Time Performance on a Unified
Lakehouse
Covered by
3 sources
See all sources covering this story
including
heise online
,
dataengineeringcentral.substack.com
Discussed on
Hacker News
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Introducing Lakehouse//RT: Real-Time Performance on a Unified Lakehouse
⚙️
MLOps
Amazon Web Services
·
6h
6 hours ago
Why tombola chose Graviton-powered RG instances for Amazon Redshift
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Why tombola chose Graviton-powered RG instances for Amazon Redshift
🖧
Distributed Systems
medium.com
·
2d
2 days ago
Building a Serverless, Multi-Source
Data
Ingestion Framework on GCP (Snowflake & Databricks to…
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Building a Serverless, Multi-Source Data Ingestion Framework on GCP (Snowflake & Databricks to…
🏗️
Systems Design
jack-vanlightly.com
·
23h
23 hours ago
Can We Agree on a Storage/Workload Architecture Taxonomy?
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Can We Agree on a Storage/Workload Architecture Taxonomy?
🗄️
Vector Databases
venturebeat.com
·
6d
6 days ago
Databricks
says it solved the decades-old data
pipeline
problem that's been slowing
AI
agents
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Databricks says it solved the decades-old data pipeline problem that's been slowing AI agents
📈
LLM Scaling
medium.com
·
2d
2 days ago
Beyond the 80% Grind: Automated
ETL
and the Instant Synthetic
Data
Revolution
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Beyond the 80% Grind: Automated ETL and the Instant Synthetic Data Revolution
📚
RAG
rickw.bearblog.dev
·
7h
7 hours ago
Father's Day
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Father's Day
⚙️
MLOps
robertsahlin.substack.com
·
5d
5 days ago
Data
quality traffic lights (13 minute read)
Discussed on
Substack
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Data quality traffic lights (13 minute read)
🤖
AI Agents
medium.com
·
2d
2 days ago
AI
Is Changing
ETL
Pipelines
. But Not in the Way Most People Think!
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for AI Is Changing ETL Pipelines. But Not in the Way Most People Think!
✍️
Prompt Engineering
MotherDuck Blog posts
·
4d
4 days ago
Flight Plans: Templates for
AI-Native
Data
Pipelines
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Flight Plans: Templates for AI-Native Data Pipelines
🏗️
Systems Design
SD Times
·
7h
7 hours ago
pgEdge Announces ColdFront for PostgreSQL, Seamlessly Uniting
AI
, Analytical and OLTP Workloads
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for pgEdge Announces ColdFront for PostgreSQL, Seamlessly Uniting AI, Analytical and OLTP Workloads
⚙️
MLOps
SiliconANGLE
·
6d
6 days ago
Databricks
declares the end of
pipelines
with a unified platform for operational and analytical data
Love
Like
Not for me
Save
Add to your feed
Feeds
Share
Report
Off Topic
Harmful Content
Low Quality
Spam
Misleading
Duplicate
Wrong Language
Block Domain
Actions for Databricks declares the end of pipelines with a unified platform for operational and analytical data
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous post
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Discover
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help
Like
Save
Not for me
Report